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ABSTRACT 

New  concepts  and  viewpoints  are  needed  to  develop  control  algorithms  for  large  scale  systems. 
It  is  hypothesized  that  brain  functions  in  human  beings  clearly  demonstrate  the  existence  of 
superior  techniques  for  controlling  complex  systems  with  multiple  objectives.  The  theory 
of  compacts  is  investigated  as  a basis  for  learning,  memory,  and  perception. 

INTRODUCTION 

In  research  areas  like  large  scale  systems  and  cybernetics,  there  is  a great  need  for  new 
concepts  and  viewpoints  to  handle  effectively  the  complexity  of  the  problems  inherent  in 
these  systems.  Classical  control  algorithms  and  design  techniques  are  Inadequate  for  these 
systems.  The  traditional  and  sound  approach  to  developing  a methodology  for  complex  systems 
is  to  extend  the  tried  and  proven  techniques  which  have  been  developed.  The  basic  problem 
is  that  the  procedure  of  extension  from  small  to  large  exposes  the  system  analyst  to  encoun- 
tering many  new  and  different  problems  from  those  encountered  previously.  That  is,  the 
system  analyst  can  do  a highly  effective  Job  on  possibly  an  inadequately  formulated  problem. 

An  alternate  approach  to  developing  new  control  algorithms  is  to  analyze  highly  complex  bio- 
logical systems  that  have  evolved  over  time  and  exhibit  some  of  the  properties  envisioned  as 
needed  for  future  generation  large  scale  systems.  In  the  field  of  cybernetics,  the  human 
being  is  often  given  as  an  excellent  example  of  a highly  complex  system.  The  typical  human 
being  has  a tremendous  ability  to  learn,  adapt,  and  perform  and  thereby  reorder  the  environ- 
ment in  which  he  or  she  lives.  This  ability  is  derived  from  the  capacity  of  the  human  brain 
to  learn,  recall,  and  innovate  ideas,  events,  developments,  etc.  The  close  tie  between 
brain  functions  and  body  muscular  control  is  basic  to  the  profound  abilities  of  human  beings. 

A better  understanding  of  brain  function,  which  we  call  brain  theory,  would  form  the  basis 
for  a new  and  possibly  different  generation  of  control  algorithms.  We  do  not  mean  to  draw 
an  analogy  between  brain  theory  and  digital  computers.  Yes,  there  are  similarities  between 
computers  and  brain  function,  but  researchers  in  cybernetics-control  theory  have  long  recog- 
nized the  inadequacy  of  this  analogy.  The  idea  that  computers  could  be  made  to  model  brain 
function  only  if  computers  are  made  sufficiently  fast,  large  in  function  and  small  in  size 
has  also  been  discredited.  Of  course  future  generation  computer  systems  will  execute  tasks 
comparable  to  brain  functions,  but  their  organization,  input  and  output  patterns  will  most 
likely  be  totally  different  from  any  computer  system  now  in  existence  or  or  the  drawing 
boards.  Some  hard  core  problems  need  to  be  solved  prior  to  formulating  the  architecture, 
language  and  programing  of  the  needed  computers.  These  hard  core  problem  areas  Include 
input  signal  sampling  techniques  that  are  both  spatial  and  temporal;  information  storage, 
modification,  and  retrieval;  decision  making  procedures  that  involve  both  computational  and 
logic  tasks  with  variable  algorithms  to  achieve  non-unique  solutions;  command  output  signals 
that  are  both  spatial  and  temporal;  etc. 

In  this  paper  we  seek  to  describe  brain  function  in  such  a way  as  to  account  for  memory  and 
perception.  Neurons  in  the  human  brain  appear  to  function  in  large  groups,  called  compacts. 
The  neurons  in  such  a group  will  reinforce  each  other's  firing  front  moment  to  moment , so 
that  the  compactum  as  a unit  can  exist  in  a firing  "state".  The  large  number  of  elements  in 
these  groups  make  them  very  dependable  in  mental  processes  and  suggests  thev  may  function  as 
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were  the  only  kind  of  contacts  to  exist,  this  model  would  be  worthless,  for  two  reasons. 

First,  weak  contacts  are  fixed,  in  strength  and  in  number,  but  in  order  for  memory  to  occur, 
there  must  be  some  kind  of  physiological  change  occurring  in  the  brain.  Second,  consider 
the  difficulty  of  igniting  a compactum  by  external  stimuli  (perceptions).  A single  neuron 
of  the  compactum  requires  impulses  from  at  least  i contacts  in  order  to  fire,  but  the  pro- 
bability of  a given  external  simulation  sending  more  than  one  impulse  to  the  same  neuron  is, 
essentially,  zero. 

To  circumvent  these  problems,  Legendy  proposed  the  existence  of  "latent"  contacts  and  "strong" 
contacts.  An  impulse  through  a stong  contact  will  cause  a neuron  to  fire  even  if  it  receives 
no  other  impulses.  A latent  contact  can  become  strong  by  frequent  firings.  Strong  contacts 
are  of  two  kinds.  "Input"  neurons  have  strong  contacts  on  their  dendritic  ends,  "output" 
neurons  on  their  axonal  ends. 

The  presence  of  strong  contacts  directly  affects  t'.e  two  problems  mentioned  above.  The  pro- 
blem of  getting  external  stimuli  to  fire  neurons  is  now  solved,  by  assuming  that  external 
impulses  impinge  on  a strong  contact  on  an  input  neuron.  Only  one  impulse  is  necessary  to 
assure  firing.  The  presence  of  strong  and  latent  contacts  also  gives  a mechanism  for  memory. 
For  these  contacts  enable  compacts  to  combine  with  other  compacta  to  form  "super"  compacts, 
or  "major"  compacta.  Thus,  output  neurons  from  several  ignited  "minor"  compacta  can  send 
enough  Impulses  to  input  neurons  of  other  unignlted  compacta  to  cause  a major  compactum  to 
fire.  When  contacts  between  two  subcompacta  are  latent,  and  both  subcompacta  are  firing,  the 
continuous  firing  can  cause  the  latent  contacts  to  become  strong.  In  this  way,  over  a period 
of  time,  larger  and  larger  compacta  can  be  formed,  representing  more  complexity  in  memory, 
or  more  "facts"  in  memory.  By  such  a process  of  "facilitation"  fewer  and  fewer  minor  compac- 
ta need  be  ignited  to  ignite  the  major  compactum  of  which  they  are  a part.  Thus,  if  the 
minor  compacta  ignite  in  response  to  the  perceptions  of  facets  of  an  object,  then  the  major 
compactum  of  which  they  are  a part  (whose  ignition  might  correspond  to  the  perception  of 
the  object  "in  toto")  will  occur  with  greater  and  greater  frequency  with  the  passing  of 
time.  Or,  it  will  ignite  when  fewer  and  fewer  "facets"  are  presented.  This  is  the  essence 
of  recognition  and,  hence,  of  memory. 

An  interesting  sideline  to  this  theory  concerns  the  presence  of  "images"  in  the  bialn.  Con- 
sider that  an  external  slmulus,  such  as  a visual  sensation,  causes  a major  compactum  to  fire. 
This  firing  is  the  only  record  of  the  visual  perception;  that  is,  a particular  compactum 
firing  is  associated  with  a corresponding  visual  image,  and  this  firing  Is  equated  with  the 
original  stimulus.  Now  whatever  makes  this  compactum  ignite,  its  ignition  will  be  equated 
again  with  the  original  visual  stimulus.  Another  way  of  saying  this  is  that  the  only  thing 
ever  "seen"  is  the  ignition  of  certain  compacta,  so  conversely  whatever  causes  this  ignition 
also  causes  "sight".  This  might  suggest  why  memories  are  often  so  vivid  as  the  realities 
they  represent. 

An  extension  of  the  preceding  discussion  leads  to  a model  of  perception. 

A TENTATIVE  MODEL  OF  PERCEPTION 

Having  seen  how  perceptions  can  cause  compacta  to  fire.  It  is  logical  now  to  ask  whether  out- 
side, random  stimuli  are  the  only  source  of  compacta  firing.  In  particular,  consider  the 
problem  of  Internal  stimulation  of  compacta.  It  Is  obvious  that  in  any  reasoning  process, 
there  is  "something"  in  tkte  psyche  that  can  bring  different  "images"  into  play.  If  a person 
tells  someone  to  concentrate  on  an  orange,  he  can  through  some  means  bring  the  image  of  an 
orange  to  mind.  An  orange  does  not  have  to  be  present  to  make  him  "see"  the  image.  One 
might  object  that  the  written  or  spoken  word  "orange"  i_s  necessary  to  bring  the  image  to 
mind.  To  obviate  the  handling  this  objection,  think  of  the  simple  rase  in  which  one  Is 
hungry.  Suddenly,  the  Image  "orange"  Is  perceived.  There  Is  obviously  some  feedback  from 
the  somatic  state  that  Influences  the  image  which  comes  to  mind.  Or,  continuing  with  the 
Idea  of  compacta,  there  must  be  some  process  which  depends  on  the  somatic  state  that  Is 
capable  of  igniting  the  compactum  or  compacta  corresponding  to  an  orange. 

Thus  there  are  at  least  two  types  of  phenomena  which  can  excite  compacta;  exterior  input  and 
somatic.  Interior  input.  Now  consider  the  more  complex  situation  in  which  a combination  of 
interior  and  exterior  states  excites  compacta.  The  most  obvious  example  is  that  of  a thirsty 
man  passing  a water  fountain  in  an  unfamiliar  environment.  He  sees  the  water  fountain,  and 
In  It  relief  from  thirst.  The  Image  comes  to  his  mind  of  drinking  from  the  fountain.  The 
presence  of  the  water  fountain  alone  Is  not  sufficient  to  make  the  Image  appear,  for  he  may 
pass  unfamiliar  water  fountains  many  times  without  noticing  them.  Likewise,  his  own  somatic 
state  is  not  necessarily  responsible  for  the  image,  for  he  might  have  anticipated  a different 
solution,  such  as  going  to  a restaurant  for  a glass  of  water.  Thus  it  must  be  the  combina- 
tion of  states,  interior  somatic  with  exterior  environmental,  which  causes  the  image. 

This  can  be  related  to  the  idea  of  compact a In  the  following  way;  suppose  the  somatic  state 


Che  basic  "building  blocks"  of  memory  and  perception.  When  certain  assumptions  are  made 
about  the  physical  nature  of  neurons,  compacts  can  be  studied  statistically.  In  particular, 
their  existence  and  lower  limit  to  their  sire  can  be  established.  A fairly  simple  stability 
problem  can  be  solved  using  the  mathematical  formulae  developed  herein. 

BACKGROUND 

The  science  of  mathematical  neurophysiology  has  produced  some  very  fine  work  in  its  short 
history.  Perhaps  the  first  study  to  suggest  a workable  scheme  of  the  brain  was  the  McCulloch- 
Pitts  model  of  neural  activity,  propounded  in  1943  in  an  article  entitled  "A  Logical  Calculus 
of  the  Ideas  Inmanent  in  Nervous  Activity"  [ 1 ] . This  work  described  how  the  neurons  of  the 
cortex  could  be  considered  as  logic  units  In  a computing  system,  thereby  giving  a solid  ana- 
lytical basis  to  neural  behavior.  As  important  as  this  work  was,  it  has  become  apparent  that 
the  brain  differs  greatly  from  the  digital  type  of  mechanism  described  there.  The  most  ob- 
bious  ways  in  which  the  brain  diverges  from  a digital  mechanism  are  its  redundancy,  its 
flexibility,  and  its  "gestalt"  recognition  properties.  It  became  very  important  to  postulate 
a more  "organic"  approach  to  neural  activity.  In  effect,  having  shown  that  a system  such  as 
the  brain  could  function  like  a computer,  and  do  the  things  that  computers  are  able  to  do, 
there  was  a need  to  determine  how  the  brain  actually  does  work.  To  this  end  the  work  of 
R.  Legendy  12],  along  with  others,  pointed  out  very  fruitful  directions.  He  suggested 
that  the  relevant  "building  blocks"  of  the  brain  are  not  the  individual  neurons,  hut  are 
rather  groups  of  neurons  acting  in  concert.  These  groups  and  their  behavior  can  be  studied 
statistically  in  conjunction  with  some  ideas  of  modern  systems  theory. 

A DISCUSSION  OF  COMPACTA 

According  to  Legendy,  neurons  in  the  cortex  form  groups,  which  he  labelled  "compacts"  which 
have  a "reverberatory"  nature.  This  means  that  when  each  neuron  of  such  a group  is  firing, 
each  member  continues  to  fire  because  of  contacts  with  the  other  members  of  the  group.  Thus, 
the  compactum  will  remain  "ignited"  until  the  neurons  become  "fatigued"  or  their  thresholds 
become  too  high.  Since  the  time  required  to  fatigue  the  neurons  is  much  longer  than  the 
duration  of  neuronal  firing,  these  structures  can  be  considered  "stable."  As  a result,  the 
firing  of  groups  can  be  studied  instead  of  the  firing  of  individual  neurons.  The  large 
numbers  of  neurons  composing  such  groups  facilitate  statistical  and  probabilistic  analysis 
which  would  be  prohibitively  difficult  if  applied  to  Individual  neurons. 

Legendy  suggested  that  these  compacts  could  be  ignited  by  perceptual  Impulses,  and  also  that 
compacts  could  combine  to  form  even  larger  groups,  called  "major  compacts",  by  means  of 
"strong"  and  "latent"  contacts  between  neurons  of  different  individual  (or  "minor")  compacts. 
He  then  suggested  how  this  model  can  account  for  several  observed  properties  of  memory,  such 
as  (1)  the  "gestalt"  property  of  perception,  whereby  objects  can  be  recognized  even  with  some 
facets  missing,  (2)  the  very  large  memory  capacity  of  the  human  brain,  and  (3)  the  observed 
lack  of  impairment  of  local  and  mental  functions  when  whole  areas  of  the  cortex  are  removed. 

Some  of  the  difficulties  of  the  Legendy  model  will  be  discussed,  and  a device  which  may 
extend  the  model  from  simply  a memory  scheme  to  an  actual  perceptual  mechanism  will  be 
suggested.  To  facilitate  this  discussion  it  is  necessary  to  formulate  a simplified  model  of 
the  neuron. 

A MODEL  OF  THE  NEURON 

In  order  to  proceed  analytically,  much  of  the  fine  structure  of  neurons  must  be  ignored 
because  of  the  mathematical  difficulties  involved.  In  particular,  it  is  necessary  to  assume 
all  neurons  are  similar,  with  the  same  number  of  dendrites  and  the  same  value  of  threshold 
potential  T.  In  addition,  individual  dendritic  weights  are  all  assumed  to  be  unity,  thus 
ignoring  inhibition.  Axonal  lengths  are  assumed  to  vary  in  accordance  with  a distribution 
function  to  be  discussed  later. 

The  most  drastic  simplification  is  to  discretize  the  time  scale.  All  neurons  are  expected  to 
act  in  synchronism  with  time  increments  At.  Thus,  if  a neuron  receives  »t  impulses  at  time 
to  , it  will  fire  at  time  to  + At  and  simultaneously  the  neurons  to  which  it  sends  contacts 
will  receive  these  impulses.  This  assumption  seems  warranted  when  dealing  with  the  neurons 
in  a compactum  because  the  compactum's  firing,  unlike  that  of  an  individual  neuron,  is  a 
steady  state  process  and  thus  the  actual  numbers  of  input  Impulses  can  be  replaced  by  the 
average  number  of  input  Impulses,  at  least  for  a first  approximation.  Of  course,  the  steady 
state  approximation  breaks  down  after  the  neurons  in  a compactum  become  fatigued,  but  at 
this  time  the  compactum  simply  stops  firing  as  a result  of  increase  of  the  individual  thres- 
hold potentials.  Thus  fatigue  acts  an  a natural  delimiter  of  compactum  firing. 

The  contacts  which  have  been  described  here  are  known  as  "weak"  contacts  in  Legendy 's  article. 
Their  presence  guarantees  the  existence  of  compacts,  as  will  be  shown  later.  If  weak  contacts 
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Induces  a certain  number  of  Input  neurons  to  fire  through  some  mechanism,  such  as  the 
Reticular  Activating  System.  Assume  the  exterior  perceptions  Induce  another  number  of  input 
neurons  to  fire.  Now  suppose  that  the  levels  of  these  firing  can  be  adjusted  by  some  fil- 
tering mechanism,  and  that  the  resultant  number  of  input  neurons  firing  can  be  held  more  or 
less  constant.  In  this  way,  the  number  of  Ignited  r.lnor  compacta,  and  hence  the  number  of 
Ignited  major  compacta,  can  be  held  fairly  constant,  at  such  a level  that  the  organism  can 
adequately  deal  with  the  information  content.  This  should  produce  a sort  of  movie  effect, 
with  the  environment  and  the  organism's  homeostatic  mechanism  in  the  role  of  the  projector, 
and  the  space  of  compacta  as  the  screen. 

Such  a scheme  may  also  throw  some  light  on  the  associative  process.  For  It  is  logical  to 
assume  that,  as  the  exterior  environment  changes,  some  compacta  may  remain  ignited  as  others 
stop  firing.  Assuming,  again,  that  ignited  subcompacta  correspond  to  elemental  aspects  of 
observed  phenomena,  some  continuity  of  mental  imagery  should  be  expected.  This  continuity 
is  central  to  association  In  mental  functioning. 

Figure  1 gives  an  Idea  of  how  such  a mechanism  could  work  in  conjunction  with  the  organism's 
homeostatic  mechanism  to  give  a crude  picture  of  the  behavioristic  process.  In  a very  real 
sense,  the  process  la  the  homeostatic  mechanism.  Notice  that  there  Is  feedback  from  the 
approach  and  avoidance  implementation  schemes  to  the  Internal  somatic  states,  meaning  that 
once  the  major  somatic  needs  of  the  organism  are  met,  the  homeostatic  mechanism  turns  to 
needs  of  the  next  highest  priority. 

There  Is  no  need  to  assume  that  this  simple  on-off  preference  scheme  is  the  only  way  the 
brain  functions.  If  the  theory  of  compacta  is  correct,  probably  the  process  is  more  like 
the  following:  the  Reticular  Activating  System  sets  up  a pattern  of  somatic  "need"  with 
internal  stimuli  feeding  Impulses  into  the  cortex.  As  different  external  stimuli  Impinge 
upon  consciousness,  the  Internal  stimuli  act  to  reinforce  the  firing  of  compacta  which  are 
related  to  these  needs.  The  brain,  so  to  speak,  ignites  major  compacta  in  the  same  way  that 
a director  screens  actors  for  parts.  Slmuli  from  the  Internal  and  external  states  combine 
to  Ignite  compacta  which  are  tested  for  their  suitability  in  the  roles  available. 

The  "play"  In  which  all  this  takes  place  is  the  "need  pattern"  of  the  organism.  This  "need 
pattern"  can  be  quite  complex,  and  the  more  universal  of  these  patterns  become  "myths",  or 
archetypes.  An  example  might  be  the  need  pattern,  or  archetype,  associated  with  the  concept 
of  "Mother".  Conversely,  these  archetypes  owe  their  potency  to  the  fact  that  they  elucidate 
certain  basic  need  states  of  the  organism. 

If  the  foregoing  concepts  are  correct.  It  appears  that  the  model  proposed  here  may  explain 
certain  very  basic  mental  functions.  Thus  a quantitative  analysis  seems  merited.  The 
beginning  of  such  an  analysis  follows. 

STEPS  TOWARD  A QUANTITATIVE  MODEL 

An  important  goal  of  this  Investigation  is  to  prove  the  existence  of  compacta.  Using  Ini- 
tially the  model  of  Legendy,  it  Is  considered  that  each  neuron  sends  out  n contacts,  which 
are  distributed  with  equal  probability  throughout  the  cortex. 

This  assumption  does  not  conform  very  closely  with  the  actual  situation,  but  its  similarity 
allows  a straightforward  mathematical  analysis  which  can  be  adapted  to  a more  complicated 
model  later.  There  It  will  be  shown  that  this  simple  model  gives  quite  meaningful  results. 

Given  a randomly  chosen  group  of  N neurons,  consider  the  probability  that  this  group  com- 
prises a compactum.  For  this  to  be  true,  each  neuron  in  the  group  must  receive  contacts 
from  at  least  t other  neurons  In  the  group.  The  probability  of  a given  neuron  having  a con- 
tact from  any  other  neuron  Is  ^ , where  B is  the  total  number  of  neurons  in  the  brain.  The 

N-l  n “ n N"1_n 

probability  of  having  exactly  m contacts  from  the  N-l  other  neurons  Is  ( ) (— ) (l--r) 

tn  B d 

Since  J <<  1,  it  follows  that  for  m <<  N-l,  which  is  the  case  of  interest,  a Poisson  diatri- 
B 

n Nn  Nn 

button  is  described.  The  mean  number  of  contacts  will  be  (N-l)  ^ ^ — so  that  X - — and 

. HDD 

-A.  m 
e X 

p(m,X)  - — : — . To  have  a compactum  it  Is  required  that  every  neuron  receive  r or  more 
in ! 

contacts.  The  probability  of  one  neuron  receiving  this  number  of  contacts  Is  p(t,X)  + 
p(t+1,A)  +p(t+2,A)  + ...  If  this  cumulative  probability  Is  represented  as  f(t,X),  the 

probability  of  N random  neurons  being  a compactum  is  f(i,X)  . But  such  a group  can  be 


chosen  in 


(B-N) ! N ! 


ways  from  the  neurons.  So  the  total  expected  number  of  compacta  of  size 


i 


N will  be: 


E(N) 


If <t,A)1N 


B! 

(B-N) ! N! 


(1) 


Taking  the  natural  logarithm  and  using  the  approximation  lnX!  ^ XlnX-X  gives  the  expression 

lnE(N)  - N In  f (t , A ) + B In  B- (B-N) In (B-N)-N  In  N (2) 

For  small  N this  expression  is  negative,  representing  essentially  zero  probability  of  the 
existence  of  even  a single  compactum  of  size  N.  The  smallest  compactum  expected  to  exist 
will  correspond  to  an  N which  causes  In  E(N)  to  change  from  negative  to  positive. 

Using  A * ——  , B * 1010,  n - 104 , t ■ 100,  and  a table  of  cumulative  Poisson  terms  gives 

the  following  table: 


N 

A 

fUOO.JO 

In  E(N) 

70  X 106 

70 

.00043037 

-3.8  X 108 

73  X 106 

73 

.00155738 

-3.9555  X 107 

74  X 106 

74 

.00234093 

-1.2099  X 107 

73  x 10b 

75 

.00335244 

1.48177  X 107 

80  X 106 

80 

.017108 

1.4098  X 107 

Table  X 


It  follows  from  this  development  that  compacta  may  indeed  exist,  with  the  smallest  compactum 
being  of  the  order  * 75  X 10^.  Notice  that  the  expected  number  of  compacta  of  size  N 

is  a very  large  number;  E(N^)  ■ exp  (1.48  X 107).  Offhand  this  result  might  appear  disas- 
trous to  the  theory,  for  it  would  indicate  that  any  mechanism  that  ignites  compacta  by 
slowly  raising  the  number  of  Impulses  to  input  neurons  will  have  to  be  unreasonably  sensitive 
to  ignition  to  prevent  neuronal  firing  from  spreading  throughout  the  cortex.  A little 
consideration,  however,  shows  that  the  counting  scheme  used  here  counts  two  compacta  as 
different  if  even  one  neuron  is  different  between  them.  In  other  words,  the  quantity  E(N) 
is  much  larger  than  the  actual  number  of  compacta  present. 

B! 

It  is  reasonable  to  ask  how  many  of  the  ) i n j groups  enumerated  can  be  counted  as 

"different"  compacta.  A tentative  answer  might  be  that  two  compacta  are  "different"  if  the 
ignition  of  one  does  not  appreciably  enhance  the  chances  of  the  ignition  of  the  other. 

This  problem  is  too  complex  to  deal  with  here,  and  it  shall  simply  be  remarked  in  passing 
that  its  presence  does  not  Invalidate  the  approach  outlined  in  the  previous  pages,  since 
there  the  inquiry  regarded  only  the  existence  of  compacta  and  not  their  "individuality". 

More  will  be  said  concerning  this  later. 

Having  demonstrated  the  existence  of  compacta  within  the  framework  of  Legendy’s  assumption 
of  spatial  homogeneity  of  contacts,  one  can  embark  with  more  confidence  upon  the  beginnings 
of  a more  physiologically  accurate  model  of  compacta. 

THE  NO-TOUCH  ASSUMPTION  AND  THE  POISSON  DISTRIBUTION 


It  is  crucial  to  get  some  Information  on  the  sizes,  shapes,  densities  and  distributions  of 
compacta  in  order  to  understand  how  to  limit  the  number  of  them  excited,  since  the  homeo- 
static mechanism  would  avoid  the  dangerous  situation  inherent  in  the  simultaneous  firing  of 
a high  percentage  of  the  total  neuronal  population.  For  a given  spatial  configuration  in 
the  cortical  area,  it  is  desirable  to  estimate  the  density  of  compa  ta  having  that  configu- 
ration. In  making  this  estimate  assume  that  the  density  of  contacts  from  a neuron  is  given 
by  p(r),  where  r is  the  distance  between  the  neurons.  The  work  will  be  much  easier  after 
making  an  additional  assumption,  which  can  be  called  the  No-Touch  Assumption;  namely,  given 
any  two  neurons,  the  a priori  probability  of  a contact  between  them  is  much  less  than  unity 
This  would  appear  to  be  incorrect  with  regard  to  very  close  neurons,  but  since  almost  all 
axons  are  noticeably  longer  than  the  dendrites,  neurons  in  the  close  vicinity  of  each  other 
are  not  apt  to  have  contacts. 

The  advantage  of  the  No-Touch  Assumption  is  that  the  Poisson  distribution  can  be  used  when 


— 


7Z 
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it  applies.  Consider  the  impulses  being  received  through  a particular  neuron's  dendrites 
from  a particular  group  of  m neurons  located  at  a fixed  distance  away  from  the  first.  Assume 
a probability  p of  contacts  between  any  one  of  the  neurons  and  the  one  being  considered. 

Then  the  probability  of  r contacts  in  all  from  the  m neurons  is  pr(l-p)m  r(m).  In  the  case 
P <K  1.  r <<  m,  this  is  a Poisson  distribution;  r 


d(r,X) 


(3) 


where  X • mp  is  the  mean. 


The  usefulness  of  the  Poisson  distribution  is  twofold.  First,  the  single  parameter  X gives 
all  the  information  needed  about  the  distribution  and  Is  simply  the  mean,  an  easily  calcula- 
ble entity.  Secondly,  the  distribution  of  the  sums  of  Poisson  variables  is  also  a Poisson 
distribution,  with  a X that  is  simply  the  sum  of  the  individual  X's.  This  is  most  easily 
seen  by  considering  the  M.C.F.  (Moment  Generating  Function)  of  a Poisson  distribution,  the 


term  e If  two  Poisson  distributed  variables  are  added, 
will  have  an  M.C.F.  equal  to  the  product  of  their  two  M.G.F.'s, 
*(  So  the  resultant  distribution  is  simply 


the  resulting  distribution 

Xite11-!)  X2(et-1) 
or  e 1 e * ■ 


d (r , X ] ♦ X2) 


e-(v‘+x2>(x1+x2)' 


Thus  In  looking  at  the  distribution  of  contacts  being  sent  from  other  neurons  to  a "test" 
neuron  it  is  necessary  only  to  find  the  mean  number  of  contacts,  and  use  that  number  as  X 
for  a ?~Jsson  distribution. 


THE  CALCULATION  OF  X 


Again,  consider  a test  neuron,  imbedded  with  a Cartesian  coordinate  system,  (X,Y,Z),  at  a 
point  (x,y,z).  It  is  necessary  to  find  the  mean  number  of  contacts  impinging  on  this  neuron 
from  all  neurons  in  a certain  group.  Assume  that 

p (r ) - p(((x-x*)‘  ♦ (y-y')‘  ♦ (z-z')2]S  (A) 

is  the  probability  of  contacts  from  a neuron  at  (x,y,z)  to  (x',y',z')  as  a function  of 
distance  of  separation.  That  is,  if  neuron  A is  separated  from  neuron  B by  a distance  R, 
the  probability  of  A sending  a contact  to  B (or  of  B sending  a contact  to  A)  is  p(R).  In 
addition,  consider  a group  with  spatial  density  c(x,y,z);  thus  in  one  unit  of  volume  at 
point  (x,y,z),  there  are  o(x,y,z)  neurons  in  this  group.  The  expected  number  of  contacts 
to  a neuron  at  point  (x,y,z)  from  all  neurons  in  this  group,  which  Is  designed  by  (x,y,z), 
is  given  by 

(x.y.z)  - ///  ([(x-x')2+(y-y')J(z-z,)2],5)o(x,V,z')dx'dy,dz' 


- P*o  (5) 

where  It  la  understood  that  o(x',y',z')  - 0 If  (x'.y'.z1)  Is  outside  of  the  cortical  area, 
and  the  symbol  * Indicates  convolution.  Thus,  the  obvious  thing  to  do  Is  take  the  Fourier 
transform  of  both  sides,  giving 

♦<ki,k2,k3)  - P(k1,kj,k3)-0(k1,k2,k3)  (6) 

where  $,  P,  and  0 are  the  Fourier  transforms  of  0,  p,  and  o respectively. 

This  equation  gives  the  required  function,  In  theory  at  least,  when  the  Inverse  Fourier 
transform  Is  taken.  Alternatively,  It  Is  possible  to  work  backwards,  and  Inquire  what 
spatial  distribution  will  render  a specified  probability  distribution,  by  rewriting  the 
equation  In  the  form 


0 (k  ,,k  2,k  3) 


»(k| ,k2,k3) 
P(k) ,k2 ,k3) 


This  value  of  this  formulation  will  become  apparent  shortly. 


(7) 


t 


i *■’  ' 


Having  found  (x.y.z)  it  is  possible,  theoretically,  to  calculate  the  number  of  compacts  with 
spatial  distribution  o(x,y,z).  Using  the  notation  explained  before  for  the  cumulative 
Poisson  distribution,  and  working  with  the  natural  logarithm  of  E(N)  gives 

lnE(N,o)  = ///[In  f(t,  (x,y,z)[  o (x,y ,z)dxdydz 
—00 

00 

+ N In  oq  - ///o(x,y,z)  In  0 (x,y ,z)dxdydz  (8) 


with  fffa (x,y ,z)dxdydz  « N understood. 


The  first  term  comes  about  from  taking  the  logarithm  of  n f(i,  (x.,y  ,z.))  where  the  i 

i»l  111 

index  runs  over  the  positions  of  all  the  neurons.  The  second  and  third  terms  concern  the 
number  of  ways  that  a group  of  size  N can  be  chosen  from  a distribution  , where  the  symbol 
Oq  indicates  the  density  of  all  neurons  In  the  cortex.  A neuron  in  position  (x.y.z)  can  he 


replaced  by  any  of 


o (x.y.z) 


neurons  and  the  distribution  will  be  unchanged.  Tims,  the  ori- 


T. iking  the  logarithm  ot  this 


v ,7*'  ' N O0 

ginal  probability  must  be  multiplied  by  **. r.  Taking  the  logarithm  of  this 

i-i  'vyrV 

number  gives  the  second  and  third  terms  in  equation  1 8 ) . The  expression  //.’  In  dxdydz  is 
associated  with  the  "informat i on"  (or  the  "entropy")  of  the  distribution. 

This  form  of  the  equation  is  usually  intractable,  given  t h«  la>  k t »n  anil\ti«al  expression 
for  f (t  , A ) . But  at  least  one  case  can  be  handled;  that  is.  If  a (f.  his.n  u<  I.  that  t Is 
constant  over  the  extent  of  the  compacta.  In  this  case  the  m«  »n  nusl  ur  t i t th  re<eivtd 
per  neuron  is  constant  over  the  volume  of  the  compacta.  Then  ft  , ) will  the  sam*  tor 
every  neuron.  Consider  a spherical  compactum  with  radius  K md  • .p«  I f t « t.  be  • Then 

i A0  r <_  R0 

6(r)  * [ <9} 

I 0 r - R0 

where  r is  measured  from  the  center  of  the  sphere.  It  tin  I.  tut  i in  t -n  t it  defined 


Kk1.k2.k3)  - ///  eKkix+k2y+k,z)  , (xy>i,  )dxdvd. 


then  it  can  be  shown  that 


*(k,.k7.k,)  = Wo  (s-ln-''4Rn  - ^c-,-H-k-|Roi 

|k|  kl‘ 

where  |k|  » (ki2  + k22  + ks2)*5. 


Now  if  analytical  expressions  for  p(x,y,z)  and  P(kj ,k  ,k<)  * an  he  t ound , equation  (7)  can  be 
used  to  get  <Kk1.k2.k3)  and  then  6(x,y,z)  and  from  this  is  calculated 

00 

N - fff  6 (x, y , z )dxdydz  - 6(0, 0,0)  (11) 

In  this  way  it  is  possible  to  determine  the  functional  dependence  of  E(N)  upon  N,  where  it 
is  understood  that  this  particular  probability  is  used.  It  is  expected  that  E(N)  will  be 
larger  for  this  distribution  than  most  others,  because  of  the  homogeneous  distribution  of 
probabil ities. 

This  section  is  closed  with  a short  discussion  of  a possible  form  of  p(r).  It  is  desirable 
to  find  a form  which  is  both  tractable  mathematically  and  accurate  physiologically.  A 
priori  considerations  indicate  that  the  p(r)  dependence  on  r should  roughly  resemble  Figure 
2.  This  simply  indicates  that  the  probability  of  finding  a contact  between  very  close 
neurons  or  very  distant  neurons  is  small,  and  that  the  distribution  has  a rather  broad 
maximum  about  the  point  rg,  which  shall  be  called  loosely  the  "average"  axonal  length. 

After  much  trial  and  error,  it  is  found  that  possibly  the  most  reasonable  simple  analytical 
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expression  for  p(r)  is  p(r)  • Br^e  . This  can  be  adjusted  to  have  a maximum  at  r - tq  by 


manipulating  a.  6 is  adjusted  so  that  / 4Tir‘p(r)dr  * n where  n is  the  total  number  of  con- 

0 

tacts  per  neuron.  These  two  conditions  can  be  expressed  formally  in  terras  of  the  equations 

1 ,o  2 a ‘n 

a = — r and  6 = 

*0 


3.* 


The  values  of  r0  and  n can  be  determined  experimentally.  A sketch 


of  this  function  with  a * 1 , 0 * 1 is  shown  in  Figure  2b. 


This  is  probably  not  the  exact  distribution  function,  of  course.  It  is  suggested  because  it 
is  much  more  true-to-life  than  Legendy's  model,  and  allows  for  axons  which  are  very  long 
(which,  it  is  known,  do  exist)  and  also  because  of  its  simple  form.  Another  nice  feature 
of  this  function  is  the  fact  that  its  Fourier  Transform  can  also  be  expressed  analytically. 


P(|k[) 


(12) 


This  fact  can  be  used,  as  shown  previously,  for  calculating  0 and  thus  6(x,y,z). 


STABILITY  AND  OTHER  PROBLEMS 


Perhaps  the  most  important  problem  to  emerge  concerns  the  stability  of  compacts.  Compacta 
have  been  shown  to  exist,  but  there  is  no  guarantee  that  thev  can  be  ignited  independently 
nor,  indeed,  that  a few  compacta  may  be  ignited  without  producing  the  "snowball"  effect  of 
igniting  the  brain's  neurons.  In  effect,  the  phenomena  of  compacta  contains  a wealth  of 
crucial  problems  for  stability  analysis.  This  point  is  amplified  in  the  mechanism  of 
ignition  itself.  If  compacta  are  ignited  by  impulses  impinging  on  input  neurons,  it  is 
necessary  to  ask  whether  only  a few  compacta  can  be  ignited  without  igniting  all,  or  a 
significant  portion,  of  the  brain's  neurons. 


Suppose  a compactum  is  composed  of  N neurons  scattered  at  random  throughout  the  cortex.  If 


Co  is  the  density  of  neurons  in  the 
in  the  cortex.  Then  for  everywhere 


cortex,  then  o~  ^ oq  is  the  density  of  compactum  neurons 
except  close  to  the  cortical  surface,  A = ~ n * approxi- 


mately, where  A is  again  the  mean  number  of  contacts  to  a test  neuron  in  a compactum  contri- 
buted by  other  compactum  neurons.  Here  the  only  assumption  m 'e  about  the  c(r)  function 
of  the  neuron  is  that  the  ro  is  not  too  large.  The  larger  the  ro»  of  course,  the  more  sub- 
stantial the  dropoff  of  A toward  the  surface  of  the  cortex.  Suppose,  for  a first  approach, 
that  A is  uniform  over  the  cortical  area.  A more  exact  treatment,  of  course,  would  invoke 
the  equations  used  toward  the  end  of  the  previous  section. 


Then  o=  gOu  is  constant  over  the  cortical  area,  and  equation  (8)  yields 


or 


lnE(N,o)  = ///lnf(i,— ) odxdydz  + Nlnop  - ///alnodxdydz 

D 

“ N lnf(r,^p)  + N In  oo  - N In  c 
lnE(N,o)  * N lnf(T.^r)  + N In  B - N In  N 

D 


(13) 


The  reader  should  notice  the  similarity  between  this  and  equation  (2),  quite  surprising  in 
light  of  the  simplicity  of  the  earlier  model.  Indeed,  they  are  so  close  that,  for  the 
solution  of  the  equation  for  the  smallest  size  of  compactum  expected,  the  solution  for  (2) 
may  be  substituted,  giving  again  Nq  * 75  X 10^.  The  slight  difference  between  the  two 
equations  probably  arises  from  the  specification  of  the  spatially  homogeneous  nature  of 
the  present  case. 


For  this  special  case  some  aspects  of  the  stability  problem  may  be  discussed;  in  particular, 
the  problem  of  extraneous  ignition  of  compacta.  Consider  two  compacta  of  size  Nq.  ~— 

neurons,  on  the  average,  can  be  expected  to  be  shared  by  the  two  compacta.  In  addition, 
some  neurons  in  the  second  compactum  and  not  in  the  first  will  be  ignited  by  the  firing  of 

the  first.  The  probability  of  a given  neuron  being  so  excited  is  Just  f(x,A)  - f(100,^j^) 

B 

since  no  spatial  homogenlty  is  assumed.  Thus  N f(100,  ^^^-)  + neurons  will  be 

B B 


"erroneously"  excited.  If  No  = 75  X 10^,  Table  I shows  that  this  number  is  about  80  X 104. 
This  number  is  only  about  1%  of  the  coropactum  size,  and  so  there  is  negligible  chance  of 
one  ignited  compactum  causing  another  to  tire  erroneously. 

Admittedly,  this  case  is  oversimplified.  Very  seldom  would  only  one  or  two  compacts  be 
expected  to  be  firing.  But  the  discussion  above  makes  stability  of  compact a more  believe- 
able,  whereas  a more  sophisticated  treatment  is  quite  beyond  the  scope  of  this  paper. 

CONCLUSION 

This  is  an  introduction  to,  and  certainly  not  an  exhaustive  treatment  of,  the  theory  of 
compacta.  Indeed,  only  the  basic  concepts  have  been  outlined,  along  with  suggestions  for 
formulating  them  mathematically. 
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